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" IMAGE PROCESSING METHOD AND SYSTEM FOR EXTRACTING A STRING OF 
POINTS FOLLOWING A THREADLIKE STRUCTURE IN A SEQUENCE OF IMAGES " 



Description 

Field of the Invention 

The invention relates to an image processing method and to an image 
processing system for extracting a path following a threadlike structure in a sequence 
of images. The invention further relates to a medical examination apparatus for 
carrying out said method using said system. The invention finds for example its 
application in the medical field of cardiology, for guide-wire extraction in X-ray 
fluoroscopic images or for thin vessel extraction in arteriograms. 

Background of the Invention 

A method for extracting threadlike structures is already known from the 
patent application WO 00/39753. This document describes an image processing 
method and an X-ray apparatus having processing means for extracting a threadlike 
structure represented on the background in a noisy digital original image, including 
steps for acquiring said original image data and reducting said original image while 
using a transformation operation so as to provide a reduced image, and in said 
reduced image, steps for selecting the most probable locations of guide-wire points by 
selecting, at each point, the direction of the guide-wire as the best match with one of 
several predetermined regularly oriented directions, and by probing the contrast 
around and in said selected directions. Then, in the original image, the method has 
steps for probing the contrast around said selected locations, and extracting the 
points that satisfy a contrast condition, connecting the points that also satisfy a 
connectivity criterion in the reduced image, and extracting said points as guide-wire 
points of the original image. 

Summary of the Invention 

This known method is available for the extraction of guide-wires that were 
designed several years ago, or for the extraction of vessels that are not too thin. Now, 
the most recently designed guide-wires are much thiner than the former guide-wires. 
And now, the practitioners are much more demanding about the resolution of very 
thin vessels. So, this method, which processes one image at a time, would present a 
calculation load actually heavy for real time processing of a sequence of images if the 
steps were to be applied to images requiring still higher sensitivity and selectivity. As a 
matter of fact, in cardiology, medical procedures using catheters deeply rely on the 
correct visibility of the guide-wire, which is a metallic wire introduced in a vessel for 
guiding the catheter. The guide-wire extraction is the detection and the location of the 
points belonging to said guide-wire in an arteriogram image. The newly designed type 



of guide-wires is much more difficult to visualize in a noisy fluoroscopic image than the 
former type of guide-wires. However, it is vital for the patient that the practitioner 
exactly visualizes the guide-wire that is moved in the artery. That is the reason why 
the method and system to extract a guide-wire must be adapted to the newly 
designed guide-wires. Also, for the application of new medical techniques, the 
extraction of thin vessels must be improved. An example is in cerebral arteriography. 
The known method is apt to be carried out in real time but it does not meet the 
requirements due to the above described new techniques and technologies. It is not 
precise enough and robust enough to extract such thin threadlike structures. 

It is an object of the invention to propose a method precise and robust to 
extract threadlike structures according to the requirements of the present techniques 
and technologies. Such a method is claimed in Claim 1. This method is carried out 
using temporal information, which is provided by a sequence of images. It is to be 
noted that the introduction of a guide-wire, or the observation of thin vessels are 
operations that can take one or several hours. These operations are registered by 
forming sequences of images on which the practitioner follows the procedures. As 
these images are noisy, they are processed to extract the objects of interest. 
Regarding guide-wire procedures, the guide-wire is introduced in the artery and 
moved forward at an irregular pace, with episodes of very slow motion or immobility 
alternating with episodes of faster motion. This particular way of moving the guide- 
wire is taken advantage of for processing an image of the past, in a sequence of 
images, or a few number of images of the past, besides the image observed at the 
instant of the present, in order to extract precisely and robustly the threadlike 
structure in said present image processed in real time. According to the principle of 
the invention, temporal information is detected in at least one image of the past of the 
sequence and is used to calculate prediction data. Said prediction data is further used 
for improving the guide-wire extraction in a subsequent image at the instant of the 
present. In other terms, the temporal information is acquired in a first mode, labeled 
acquisition mode, and is processed for detecting a "silhouette" of a threadlike 
structure from at least one image of the sequence acquired prior to the instant of the 
present. The "silhouette" is further processed, in a second mode, labeled pursuit 
mode, in order to provide a restrained zone in which the threadlike structure is 
precisely and robustly extracted in the image of the sequence formed at the instant of 
the present. Besides precision and robustness, the advantage of the method is that 
the processed image is provided in real time using information that is acquired in a 
time delay not necessarily compatible with real time. It is also an object of the 
invention to propose a system to carry out said method and a medical examination 
apparatus using said system. 



List of Drawings 

The invention is described hereafter in detail in reference to diagrammatic 
figures wherein: 

FIG.l is a functional block diagram of the main steps of the method; 

FIG.2A illustrates the information obtained at one instant of the past, and 
the silhouette derived from said information; RG.2B illustrates the information 
obtained at two instants of the past, and the silhouette derived from said information; 

FIG.3A illustrates the estimation of a constraint formed by the Canal Zone; 
FIG.3B illustrates the estimation of a constraint formed by the interval of directions; 

FIG.4A illustrates the step of tip evaluation and FIG.4B illustrates the step of 
shape correlation; 

FIG.5 is a functional block diagram of medical diagnostic imaging system and 
apparatus for carrying out the method. 

Description of Embodiments 

The invention relates to a method for extracting a path following a threadlike 
structure represented in a sequence of noisy images. In the example described 
hereafter, the threadlike structure is a guide-wire denoted by GW represented in an 
arteriogram sequence formed in fluoroscopy. It is an object of the invention to provide 
such a method to extract the guide-wire points in the form of a string of points, in the 
case when high resolution and high precision is required, by using temporal 
information. 

Referring to FIG.l, which is a functional block diagram, the method of the 
invention comprises: 

a first phase 10, labeled "acquisition mode", which processes an original 
image 1 or 1, 2 of the sequence formed at a first instant; the original image is formed 
of image data including point coordinates and a luminance intensity value for each 
image point denoted by X; in the acquisition mode, at said first instant, a location of 
the guide-wire in said original image is detected; said detected guide-wire is a first 
string of points; 

a second phase 20, labeled "prediction mode", which calculates, from the 
location detected during the first phase, a prediction of the location of the guide-wire, 
labeled "silhouette" to be used in a further phase of extraction of the guide-wire; the 
operation of the first and second phases may outlast the time delay imparted for real 
time processing of an image in the image sequence, which time depends on the image 
rate in the sequence; the silhouette is a string of points; 

a third phase 30, labeled "pursuit mode", which processes an image 3 of the 
sequence formed at a subsequent second instant, called present instant t, for 
extracting the guide-wire at said present instant t, using the silhouette information, 
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and using a time delay compatible with real time processing; the extracted guide-wire 
is the best possible string of points for representing the guide-wire. 

More generally, the present method is temporal and uses two or several 
images of an image sequence, comprising at least a first image 2, from which the 
silhouette is detected, said first image being formed at a first instant, called instant of 
the past, and a second image 3, from which the guide-wire is extracted, said second 
image being formed at a second instant called present instant t. In a variant, the 
silhouette may be detected by processing two subsequent images formed at instants 
of the past, that is anterior to the present instant. Setting t as the present instant, the 
silhouette may be detected from images 1 and 2 of the sequence formed at instants t- 
2 and t-1. These methods present several advantages. They are more robust a the 
known method, labeled spatial processing method, which extracts the guide-wire 
using only one image uniquely formed at the present instant, because more 
information is available from the processing of several images including images of the 
past. The calculation time for extracting the guide-wire at the present instant is 
minimized since the location and the kinetics of the guide-wire are already known 
from the results of the acquisition and prediction modes. The guide-wire may be 
extracted very precisely in a very short time by processing a limited zone around the 
predetermined silhouette. 

Referring to FIG.2A, in the acquisition mode 10, it may be chosen to process 
only one sequence image 2 denoted by I M formed at the instant t-1, where t is the 
present instant. In this case, only the location of the guide-wire at the instant t-1 is 
detected. This location is denoted by G t -i. Referring to FIG.2A, in the prediction mode, 
the detected location 6 H of the guide-wire constitutes the silhouette labeled G t , so 
that G t = G t -i. Referring to FIG.2B, in the acquisition mode 10, preferably, it may be 
chosen to process two sequence images 1, 2, denoted by I t -2, I t -i, respectively formed 
at instants t-2 and t-1, where t is the present instant. In this case, the location of the 
guide-wire at the instant t-2 is denoted by G t -2, its location at the instant t-1 is 
denoted by Gm. In the acquisition mode, the location(s) G t - 2 and/or G t -i of the guide- 
wire at the instants t-2, t-1 is (are) detected using a known spatial extraction method. 

Referring to FIG.2B, in the prediction mode, the translation value, 
represented by the arrow 5, between the location G t - 2 at t-2 and the location G t -i at t- 
1 is calculated, which permits of calculating the speed of translation of the guide-wire 
between the instants t-2 and t-1, and the translation value, represented by the arrow 
6, between the instant t-1 and the present instant t. These calculations provide a 
calculated location of the guide-wire, labeled silhouette G t = P(G t ), at the instant t, 
where P is a prediction function. In the prediction mode, the translation values may be 
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calculated using techniques known of those skilled in the art, such as a "distance map" 
technique. 

Referring to FIG.3A, in the pursuit mode 30, the silhouette G t is considered 

in the sequence image formed at the instant t, and a process of extraction of the 

guide-wire Gt is carried out from said silhouette G t . This pursuit mode comprises a 

procedure of estimation of constraints for performing the extraction operation based 

on the silhouette G t information. This constraint estimation comprises an estimation 

of a Search-Zone. The resulting constraint is labeled Search-Zone Constraint. 
Preferably, the Search-Zone is a canal-shaped zone, labeled Canal Zone, around the 

silhouette G t . The Canal Zone is defined for example using a morphological dilation 

as illustrated by FIG.3A. The geometrical locus where the silhouette G t is the center 

of discs D K (or spheres) is determined. To this end, for each point K of the silhouette 

G t , a disc D K from D x to D N/ is defined, centered on said silhouette G t . The discs D K 

have a predetermined radius Rt. The union of all the discs D K from Di to D N defines 
the Canal Zone CZt, which is used as a restriction zone to look for the location of the 
guide-wire G t at the instant t. This procedure of calculating the Canal Zone results in 
that the further step of extracting the guide-wire Gt in said Canal Zone is more 
efficient than a procedure without such a search zone, and is more robust because 
less sensitive to false locations, which are false extracted points of the finally extracted 
guide-wire Gt. 

The guide-wire extraction in the pursuit mode 30 may be carried out using a 
first technique comprising steps of extraction of a string of points using only the Canal 
Zone data, that is only extracting the guide-wire points when these points are located 
in the Canal Zone. In this first technique, the extraction operation is only submitted to 
one restriction condition called Canal Zone constraint, the Search-Zone being 
constituted by the Canal Zone CZ t . The guide-wire extraction in the pursuit mode 30 
may be carried out using a second technique, comprising steps of extraction of a 
string of points using not only the restriction condition constituted by the Canal Zone 
constraint, but also a restriction condition on the directions along which the guide-wire 
may be looked for, which is called Direction constraint. The candidate points for the 
guide-wire extraction are associated to a constrained interval of directions denoted by 
A9. A point is extracted under the condition that a direction associated to said point 
belongs to said direction interval A8 defined as explained thereafter. 

Referring to FIG.3B, a point X of the Canal Zone CZt is considered and an 
associated direction is looked for. Said point X belongs to a set of discs D K from Dki to 
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Dig previously defined as having a radius Rt and being centered on the silhouette G t . 
Each of these discs D K is first associated to the direction of the silhouette G t 
estimated at its center. In the set of discs, from the first disc Dki including the point X, 
to the last disc Dq including the point X, as many directions as the number of discs, 
are defined. These directions constitute a set of directions, forming an interval of 
directions that is to be considered for estimating the direction associated to said point 
X. Thus, in the method step illustrated by FIG.3B, the direction at point X is to be 
estimated in the constrained interval of directions A9 defined at the centers of the 
discs D K containing X. Referring to FIG.3C, in a variant, a point X of the Canal Zone 
CZ t is considered and an associated direction is looked for. A disc Dkx having a 
predetermined radius, for example equal to the radii of the previously defined discs 
D K , is determined centered on X. This disc Dkx intersects the silhouette G t in two 
points K u K 2 defining a segment. Each point of this segment of G t is associated to 
the direction of G t estimated at said point. This operation defines as many directions 
as the number of points of this segment of G t . These directions constitute a set of 
directions forming an interval of directions denoted by A6 that is to be considered for 
estimating the direction associated to said point X. Thus, in the method step 
illustrated by FIG.3C, the direction at point X is to be estimated in the constrained 
interval of directions AG defined at the points of a segment having a length defined by 
the intersection of a disc Dkx centered at X, with G, . 

In both cases of FIG.3B and 3C, the number of points for determining the 
constrained interval of directions A9 is a function of the distance of X to G, . When X 
is far from G t , the number of points of G t , which is considered to determine the 
number of directions in the interval A9, is few and thus directions are severely 
constrained in a small interval. When X is nearer to G t in the Canal Zone, the number 
of points of G t , which is considered to determine the number of directions in the 
interval A8, is larger and thus the number of directions is greater. So, when X is 
located near to G t , the directions are less constrained than when X is farer from G, 
in the Canal Zone. Other methods of providing a direction constraint for a point X of 
the Canal Zone may be used for fulfilling this condition. 

For extracting guide-wire points, ridges are looked for in the Canal Zone and 
preferably along the directions belonging to the constrained interval of directions. A 
ridge is a crest-like structure formed by adjacent points having intensity signals that 
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are maximum in a neighborhood, said points having specific dispositions the ones with 
respect to the others resulting in specific gradient values with respect to orientations. 
A ridge point shows a low intensity gradient in a first determined direction in its 
neighborhood, and shows an intensity gradient that is maximum in a direction 
perpendicular to said first direction. The more a given structure is formed of points 
verifying this gradient property, the more the ridgeness measure of the structure is 
high. Instead of ridges, troughs can be considered in a negative original image for 
instance obtained by x-ray imaging. In an x-ray negative image, a guide-wire is a dark 
structure on a lighter background. In this case, the calculations for extracting the 
guide-wire have for an object to extract trough points, which can be determined by 
measures similar to ridgeness calculations. In ridgeness calculations applied to troughs 
determination, the estimation of specific intensity gradients that is required for 
characterizing ridges is still valuable for characterizing troughs. So, in the description 
of the present method, these calculations are called "ridgeness" calculations, whether 
they are applied to ridges or troughs in the image. This phase comprises a step of 
"ridgeness" calculation applied to the image formed at the present instant t This 
"ridgeness" calculation is performed by applying on the points of the image at 
locations restricted to the Canal Zone, filters known as ridge-filters, which determine 
the points of the ridge structures, or of the troughs. Based on the condition of 
constraint formed by the constrained direction interval A8, the ridgeness calculation 
for a given point X of the Canal Zone is limited to the directions of said interval A8. So, 
ridgeness is calculated by this local contrast measurement in said Canal Zone and 
along the directions limited to the directions of said interval A0 and the best candidate 
string of points having the highest ridgeness is further extracted as guide-wire. 

Referring to FIG.4A, the pursuit mode preferably comprises a step of 
adjustment of the location of the tip T t of the guide-wire. Said step of adjustment 
includes a sub-step of tip evaluation for detecting whether tip adjustment is necessary 
or not. In order to decide whether the tip found for the detected guide-wire is 
misplaced resulting in an extracted guide-wire that has a missing part or an exceeding 

part, the shape of the silhouette G t is compared to the shape of the point string 

representing the guide-wire, now labeled G' t in this sub-step, found at the instant t, 
according to a technique called "shape correlation" as illustrated by FIG.4A. The tip of 

G t is denoted by T t and the tip of G\ is denoted by T t . The arrow 7 illustrates the 

translation value between G t and G\. 

Referring to FIG.4B, an operation of "elastic matching" is performed 
between G t and G' t on a diagram representing a first curve H t corresponding to G t 
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and a second curve H' t corresponding to G' t . The first and second curves H t and H' t 
represent the directions 9(s) of respectively G t and G' t at each point of respective 
curvilinear abscissa S measured in the referential of the corresponding images of the 
sequence. In a variant, instead of the direction 9 , the curvature of G t and G' t may 
be estimated in function of said curvilinear abscissa s. The curves H t and H' t start at 
a reference point denoted by SP which may be a starting point of detection of the 
point strings. A best matching of curves H t and H' t is then performed and the 
curvilinear abcissae of the tip f t of G t and the tip T c of G' t are compared. Resulting 
from the comparison, either the point string G' t is not changed, or it is lengthened, or 
it is shortened- The final tip is denoted by T t . The resulting point string is subsequently 
labeled Gt and forms the extracted guide-wire at the present instant t. Said final tip of 
resulting point string G t may be estimated using for example a known matching shape 
method such as the generalized Hough transform, which enables to find a shape from 
a known gabarit. The silhouette G t may be used as gabarit for detecting the final tip 
of the resulting point string G t . If the final result is not found satisfying, and iteration 
illustrated by the arrow 4 in FIG.l may be performed between the prediction mode 20 
and the pursuit mode 30. 

Referring to FIG.5, a medical examination apparatus 150 comprises means 
for acquiring digital image data of a sequence of images, and a digital processing 
system 120 for processing these data according to the processing method described 
above. The medical examination apparatus comprises means for providing image data 
to the processing system 120 which has at least one output 106 to provide image data 
to display and/or storage means 130, 140. The display and storage means may 
respectively be the screen 140 and the memory of a workstation 110. Said storage 
means may be alternately external storage means. This image processing system 120 
may be a suitably programmed computer of the workstation 130, or a special purpose 
processor having circuit means such as LUTs, Memories, Filters, Logic Operators, that 
are arranged to perform the functions of the method steps according to the invention. 
The workstation 130 may also comprise a keyboard 131 and a mouse 132. 
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CLAIMS 

1. An image processing method for extracting a threadlike structure (GW) 
represented in an image, comprising : 

a phase of acquisition (10) of a sequence of images, including an image of a 
present instant (t) in which the threadlike structure is to be extracted and an image of 
a past instant (t-1) in which the threadlike structure is detected as a string of points 
(G t -i), and further comprising : 

a phase of prediction (20) of a silhouette ( G t ) of the threadlike structure 

estimated from said detected string of points (G c -i), of the image of the past instant, 

a phase of pursuit (30) for extracting a final string of points (G t ) 
representing the threadlike structure in the image of the present instant t, including 

steps of estimation of constraints (C2t, 6) based on said silhouette ( G t ) for 

performing said extraction. 

2. The method of Claim 1, wherein in the prediction phase (20), the silhouette 
( G t ) is formed of the string of points (G^) detected in the image of the past instant 
(M). 

3. The method of Claim 1, wherein : 

the acquisition phase (10) comprises a first image of a first past instant 
(t-2) and a second subsequent image of a second past instant (t-1), in which the 
threadlike structure is detected as respective first and second strings of points (G t -2, 
Gt-i), 

and the prediction phase (20) comprises the calculation of a translation 
value (5) and speed of translation between the first and second strings of points (G t -2, 
G t -i), and the calculation of a translation value to occur between the second past 
instant (t-1) and the present instant (t) for estimating the location of the silhouette 

( G t ) in the image of the present instant (t). 

4. The method of one of Claims 1 to 3, wherein in the pursuit phase (30), the 
steps of estimation of constraints comprises the estimation of a Search-Zone (CZO in 

the image of the present instant (t) around the silhouette ( G t ) for a constrained 

extraction of the final string of points (GO in said Search Zone (CZO. 

5. The method of Claim 4, wherein the Search-Zone is a Canal-Shaped Zone, 

labeled Canal Zone (CZO, centered on said silhouette ( G t ). 

6. The method of one of Claims 4 or 5, wherein the steps of estimation of 
constraints comprises the estimation of an interval of directions (A8 ) associated to 
the points of the Search-Zone. 
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7. TTie method of Claim 6, wherein a neighborhood is estimated for each given 
point of the Search Zone so that said neighborhood intersects the silhouette ( G t ) and 
determines a segment (K X/ K 2 ) and wherein the directions (8) of the silhouette ( G t ) 
are determined at each point of said segment, forming a set of directions, which set of 

5 directions determines the interval of directions (A9) for a constrained extraction of the 

final string of the points that are associated to an interval of directions (A8). 

8. The method of Claim 7, wherein the Search Zone is a canal-Shaped zone 
labeled Canal Zone (CZ t ) estimated by an operation of mathematical morphological 
dilation using discs (or spheres) (D k ) of a predetermined radius (R*) around the 

10 silhouette ( G t ), and wherein the extraction of a string of points is performed in said 

Canal Zone (CZt) by ridgeness estimation along the directions of the interval of 
direction associated to each point and the final string of points (G t ) is selected from 
the points having the highest ridgeness. 

9. The method of one of Claims 1 to 8, further comprising, in the pursuit phase 
15 (30), steps of tip evaluation for determining whether the tip of the extracted string of 

points is correctly located for representing the threadlike structure in the image of the 
present instant. 

10. The method of Claim 9, further comprising in the pursuit phase (30), 
steps of shape correlation for estimating the correct location of a final tip for the final 

20 string of points (G t ) representing the threadlike structure. 

11. The method of one of Claim 1 to 10 having a loop (4) between the pursuit 
phase (30) and the prediction phase (30) for improving the detection of the silhouette 
( G t ) and the extraction of the string of points (GO for representing the threadlike 
structure (GW) in the image of the present instant (t). 

25 12. A system comprising a suitably programmed computer or a special 

purpose processor having circuit means, which are arranged to process image data 
according to the method as claimed in any one of the preceding Claims. 

13. A medical examination imaging apparatus having means for acquiring 
medical digital image data and having a system having access to said medical 

30 digital image data according to Claim 12, and having display means for displaying 

the medical digital images and the processed medical digital images. 

14. A computer program product comprising a set of instructions for carrying 
out a method as claimed in one of Claims 1 to 11. 
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An image processing method for extracting a threadlike structure (GW) 
represented in an image, comprising a phase of acquisition (10) of a sequence of 
images, including an image of a present instant (t) in which the threadlike structure is 
to be extracted and an image of a past instant (t-1) in which the threadlike structure 
is detected as a string of points (G^), and further comprising a phase of prediction 

(20) of a silhouette ( G t ) of the threadlike structure estimated from said detected 

string of points (G t -i), of the image of the past instant, a phase of pursuit (30) for 
extracting a final string of points (G t ) representing the threadlike structure in the 
image of the present instant t, including steps of estimation of constraints (C2t, 9) 

based on said silhouette ( G t ) for performing said extraction. 
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